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Assessing, the Learning Disabled Youngstér: - - 
' The State of the Art oe pos ai 


é ’ ‘ aX 
* My ae a cag this morning is to present an overview of the- 
"state of the.art" in the assessment of learning disabled youngsters.. 


Neatly. all of you are “intimately involved in the issues\I will address, 


either as parents of learning disabled children or ag those charged 
with the dant of educating learning-disabled children. What I am 
sages to argue in this presentation may be greeted with open hostility 
‘by’ some of you, personal discomfort by many of- you, and as controversial 
by most. : 
ae The -positions that I am going to take are not influenced ‘by a. 

desire on my part to be sensational or melodramatic. I have been and 

: leceeiaie to be pears gome of the directions that have been taken, 

‘ and the assumptions that have been made ieeeeallay the aves of learn- 

- * ing disabilities, both from~an academic and a pragmatic perspective. ; : 
The concerns and beliefs that I will present are th@ result of a good 
bit of incubation on my part and of ‘spirited debate with my profes- 
sional colleagues.. They’ stem directly from an obseryation on my part 
of the considerable gap that exists between current beliefs and prac- 
tices in the field of hearing disabilities and goapaeeh segence 
for thé validigy of diosa beliefs and practices. They reflect my 
desire to see this field move forward from its current overreliance 


on testimonial evidence to considerably, more reliarice on research 


findings and on practices with demonstrated validity. 


- 
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i: : 
pizet, I want to emphasize that -my professional -life is, and 
eee exsnquablyeilt continue to be, focused on studying how best, to 
deal with Perr tho have trouble in school and on the preparation ' 
of educutore tend ached. psychologists to deal si teceivdty and effi- ' 
ciently with sau youngsters. These emphases are compatible with 
those of the Minnesota Association for'Children with ‘Learning Disa-* 
bilities as well as with those oe other professional organizations 
who have an interest eee, ane special education. I appreciate 


the opportunity to address this ‘group. a, 


: . The "state of the art" in assessment of learning disabled chil- 


aa, 


dren is not good. Major theoretical, conceptual, practical, and 
empirical issues exist in the. assessment of learning disabled chil- 
dren. They can be grouped under three broad headinges First, the : .- % 8 
iets tae been characterized by the absence of a conceptual se alas 
Second, many of the current issues are decision-making issues. Third, 

* 


many issues and problems are apparent in the use of assessment data 


to plan interventions for learning disabled children. 
‘ Poy q . 
Conceptual Issues 


, In many ways, the field of learning disabilities was formed 
around a iapews one that was ner because it offered an alternative 
‘ to sRewmeietns inaccurate, si eaieas labels such.as brain-injury,  ' 
- minimal cerebral dysfunction, organic behavior disorder, perceptual | 
\ af handicap,:. central processing Aoutinteian: or dyslexia. The label ” 
"learning disabled" has remained ambiguous; the broad scope of the 


term has enabled children who evidence many different. kinds of school- 


\ - 
%, related problems to be grouped together. ~ = : kid 


- ag 
~~ 
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’ The federal definition of children with specific learning disa- ° ’ 


bilities ie widely regarded as es ed most dituctd clones and 
is édopted per se by only nine ie Children with learning disa-" | > 
bilities are defined differently in different states. Mercer’, . | 
: Forgnone and .Wolking (1976) conducted _ survey of definitions used by 

state departments: of education. Their findings are summarized in 

‘Table 1. Eighty-three percent of the 42 states that responded, included 
reference to process deficits, or disorders in their definitions. 

Academic criteria are specified in je of thé deffattions. “There is 

copa sderebiy greater vatiability in. ether components of the ‘definition. 
While 52% of the states Ho not specify level. .of intelligence as a __ ; 
criterion, 19% require that children seore above the retarded range, ' 
while 26% require average or above ‘average civeltienaues. Ten percent 
of the debinttiana state that learning disabled children have a 
central nervous system dysfunction; 14% inate, "eoctatly maladjusted" © 
in 'theircriteria for identification as learning disabled. Clearly, 
the term learning disabled is SeEnoues identification as LD-is often 


a function one's geographic location. 


" Because of the. absence of a conceptual framework and resultant 
“vaguen@ss and variability in definition, we have an extremely hetero- 


geneous group of children identified as learning disabled. 


Decision-Making «Issues 
e-- 
I define assessment broadly, as the process of collecting data 
\ 


a 
, , ’ / 


for the purpose of making educational decisions for and about chil- 


dren. Assessment is not synonymous with testing; testing is one 
part of assessment. . : ; 
John Salvia and I ‘(1978) have identtfied on different kinds 
' of decisions "Sc ido assessment, data--screening or identification 
decisions, classification or placement decisions, the anor of 


instructional int rventions, esdivation of individual pupil progress, 
aes eeeeia evaluation. Educators puis i assessment pict pur- 
pose sof shelping ten make ‘these different kinds of decisions. 
Teachers, and sometimes ani cianticae speqtaliste, administer tests 
to groups of children for the’ purpose of real bane sted: who are’ aes 
sufficiently different from ' ‘notmal" yi average that, further assess- 
ment is believed NSPEaHESH. currently, in efforts to comply with 
Public ‘Law 94-142, “chook systems and staté education agencies must . 
provide ® evidence that they are engaged in extensive "child find" 
activities. Such efforts are being implemented even at ‘ha preschool 


\ 


level where we witness an increase in efforts to identify young chil- 


" 


dren with fia ped hone learning disabilities. Massive screening of 


: a. children, in settings as diverse as public schools and Stace: 
centers, is going on with little regard fo the fact that, with $ 
the exception of youngsters who are severely developmentally delayed, 


our predictions are extremely inadeented tat r 
’ tal + 
Second, assessment “data are collected to help PEe RANI OORT make 

‘ a 4 
elaseiftcstion and placement decielons. Most state ateidands require 


that before changes are made in children's educational placements, . 


individual’ psychoeduca®ional assessments must be done. Professionals 


we have witnessed a dramatic increase in efforts designed to plan 


_ see in assessment of learning disabled children, without specific. 


5 
attempt to identify the extent to which a child is handicapped, the 


specific nature of the handicap, and to’ find the "least restrictive" 


_ educationgl environment for the child. 


: Ra : 
The third kind of decision is intervention planning. 


with the rise of sérvices to children labelled learning disabled, - 


he 


interventions for children according to their performance on batteries 
of diagnostic devices. Educators readily speak of being engaged in 


"diagnostic-prescriptive teaching," although, as we shall see, this _ 
‘term means different things to different people. 


. 


Fourth, assessment data are:used to’ evaluate individual pupil: 
. * ¢ 


progress. Parents, teachers, administrators, and children themselves 


have a right and ‘need ‘to know Ks extent to whftth children are profit- 


ing from the ‘educational services they receive. Individual pupil 
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‘progress may be evaluated eithex by examining the extent to which the 
‘i o* . ’ 


- pupil has ‘achieved specific curricular objectives, or by looking at:' 


the pupil's performance relative to that. of others the pupil's age. 


» 


Finally, ‘assessment data are used. to evaluate the relative 


effectiveness of alternative instructional programs. Typically, tests 


are administered before and after institution of a program,» pupil 
gains are examined, and program ef fectiyeness is ascertained. 
The next section of this paper Yescribes the current issues I 


7 
regard to their order of importance. Obviously, there is considerable 


i overlap among these tssues. While some issues are specific to one kind 


. 


of decision, most are interrelated and cut across the entire decision- 


making matrix. = ; ‘or 


“Current Issues in the Assessment of Learning Disabled: Children -# 


. 


The Yse of Tests for Purposes Other than Those for Which The Were 


Designed 
I have: just out lined the kinds of educational decisions that 


are made using assessment data.. Each of the five kinds of decisions 
requires that we'use different assessment’ procedures and devices. © A 
fundamental aifficulty ager tyane all other assessment issues has been 


si 


Na failure on the part of decision-makers to differentiate oe assess-~ 


ment Petaseer ney and tools in Ligne of the kinds of decisions -to be 

made. We tepestadly witness the uge of tests for purposes phe than: - 
those for which they were deetaded \ For example, the most commonly. 

used iidividual intelligence tests were designed to assist’ us in making’ 
identification and iaseaereaesta decisions. Many currently used 
individual intelligence tésts are,very adequate for \these purposes; j : 
they tell us the extent to which a youngster differs from others his/ 
her age. Yet; we repeatedly a intelligence tests being used to plan 
yet eieradivarional interventions for children. To date, research 
gtanihades not support efforts such as profile analyses of performance 
on intelligence tests in deciding what and ae to teach. children. 

Gas diagnostic personnel recognize the fact that we must collect 


different kinds of data when we make different kinds df decisions. ° \ 


Their efforts to do so are to’ be.commended. * 
’ 2 


: Ps ‘ ; ; 
Technical Adequacy of Currently Used Tests ‘ P ; 


When data are collected for the purpose of helping us make educa- i 
tional decisions about children, decisions that directly and signifi- 
cantly affect the life opportunities of those children, it is impera- 


tive that we collect our data using the most technically adequate 


le ib 10° . Pa } 


“a ? ; ’ . . 7 
devices and procedures available. 


We have; for some time, been able to articulate the necessary ai 


technical characteristics of good tests. In 1966, a joint committee | 
. . Ul 


of the American Psychological Association, American Educational Re-  ~- 
search Association, and the National een on Measurement in Edu- 
cation published a decumeht entitled skandanis for Educational and 
Psychtblogical Tests. “This aocimene: revised and expanded in 1974, 


describes in detail standards for educational ,and psychological tests. 


n 


The. standards document serves two purposes: it is a set of guidelines 
for: ‘test developers and a set oficriterda. duntags pret test users. _ 
can evaluate the technical adequacy ‘of tests. The aoniment has been 


largely ignéred by both developers and users. It is important to . 


recognize the fact that there is no regulatory commission, no "pure 


food and drug law,’ for the use of tests. The majority of currently 


used tests fail to meet minimal standards. Tif majority of test users 


pay little attention to the technical adequacy of their devices. 


‘ 
e 


There are three considerations in, evaluating the technical adequacy of 


~ 


- a test: standardization, reliability, and validity. 


Standardization. Norm-referenced tests, the kind used 


most often in making educational decisions, are standardized P 


by initial assessment of a reference group. When we assess 
children using norm-referenced “tests, we assume they have 
been exposed to éonpkeab ie acculturation, have had the same 
_ baékground experiences and epportindties, as those in the 
reference group. To the extent that the person Beates 


4 


differs re those on whom ‘the test was standardized, tie 


x, a gd 


qs 


‘ 
ae | ~ 


‘ i « . ‘ 
use of norm tables to interpi¥lt performance is meaning- 


: less, invalid, and infappropriate. The use of data obtained j 
avr a 3 “to, this way to make important decisions actually’ constitutes : 
agua As Salvia and I point .out (Ysseldyke & aioe, 1974), 
5 the nature of ‘the norm eae is extremely important; because © 
‘it determines both the group to ‘hon tested childeen are 
compared and the nature and content of the test items. 
To help us evaluate the extént to whitch the: die of 
ca par kioular test is appropriate for specific individuals, 


it is necessary that test manuals include -information about 


-] the sample on whom the test was standardized. Educational | 


\ 


practitioners too often assume that test developers "know * 


ae what they're doing" arid that because a test-is published 
it meets adequate ‘standards: One seuld assume, for example, 
_ that school psychologists. Seat know the nature of: the 
standardization samples J those tests ‘they. use daily. » 
Yet, rai I conduct. workshops for senna Savapelapieke t 
typically find that fewer than two .in any audience of 25-30 
can correctly answer any of the. Foilowtng questions! 


1. On whom was the Peabody Picture Vocabulary Test 


standardized?" 


Iie Peabody Picture Vocabulary Test was standardized on 4,012 white, 
ie mostly middle class children in and around Nashville, Tennessee. 


_ . , ‘ : ’ 
’ 2, What is the nature of the standardization sample 


for the phage Intelligence Test?? - 


cu 7. 3. On whom were the Gates-McKillop Diagnostic Read- 


ing Test . and she Durrell Analysis of Reading St: 


2 » 
DAFELCULLY standardized?» - } 


The sad fact illustrated here is two-fold. First, very many 

, of the norm-réferenced tests used daily to make important 
. : ‘ 

educational decisions for children, decisions which directly~ 


k and significantly affect their life opportunities, are in-_ 
adequately standardized. Descriptions of normative data in . * 
test manuals are often so inadequate that diagnostic personnel z 


are unable to ascertain to whom tested children are being 


compared,’ Table 2 is a list of commonly used assessment 


s 


devices whose manuals include inadequate information regard- -° 


ing those on whom the test was standardized. : { * ? 
a . : . . 


me = a‘ is Wik 
4 "of 


Paccordingyto its author, this SIT. was Standardized on children. and 


Some suffered from neurological disorders or other defects. The . : 
‘) “only cases which were excluded from this study were individuals who “4 
could not ‘speak English" (Slosaon, 1971,/p.- Iv), ; 
3No data are reported in either the Gates-McKillop or the Durrell | ‘ 
* » manual regarding the nature of the groups on whom the tests were “4 
. ' standardized.. ‘ . 
‘ e ca ‘ : . 
x ee pF4 ‘ a Sz ; we or » % ‘ ‘ tT, 
is ‘® ‘ ‘i e 2 o . . tf * 
cea ee a Meg” 


_ aduits who "came from both urban and rural populations “{n New York: 


State. The referrals came from, cooperative nursery schools, public, 
_ parochial, and private schools, from junior and senior high school. 
They came from gifted as wellas retarded classes--white, negro(sic), 
“and some American Indian. Some came from a City Youth Bureau, ‘some %: 
from a Home for Boys. The very young children resided ‘in an infant - 
home. © The adults came frdém the general -population, from various 
professional groups, from a university graduate school, from a state * 
school for the retarded and from a egunty jail. 

"Many of these individuals were difficult ‘to test as they were 
‘disturbed, negativistic, withdrawn, and many had reading difficulties. 


ad 


* assessed are like those on whom a test was standardized creates 


ane Most’ measurement authorities’ (Nunnally, 1967; Senay 


Sb ee ee Se SS ES TS Oe De 
‘ 


Insert Table 2 about here 


eee ee ee ee ae A Se ee a i hs 
‘ 
> 
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Second, and perhaps more disturbing, is the fact that few 


diagnostic personnel are even aware of the nature of the 


’  standardizatdon groups for tests they use daily. They have 4 


‘not been’ taught to report scores on the Peabody Picture 7 


. ‘ 
e mee 
a . , ¢ 


Vocabulary Test, for exsunde, by stating that "Relative ~ we 


to ‘the enanee white, middle-class child residing, in Haak . A 
ville, Tetimanee, Johnny Ack a: ee | oe ' ‘ 


a? 


Failure to consider the extent to which children 


; ) ; ; . 
enormous: difficulties when hc children are ai cl 


- 


Reliability. “Reliability ‘refers to the extent to which 
an assessment device produces consistent agentes A rubber 


; ruler, ‘for example, is an inconsistent measure of length oF : 


‘because measurements of length can vary so much simply as. 


. a Foe 
a function of error in the device. Unreliable assessment 


leads to erroneous decision-making. 


- ° 


A basic* assumption in psychoeducational assessment is 
. MN ~ ? A * 


that error is present. Reliability coefficients are ‘indexes “ 
Sof the extent to which a test is free from error. hd oo ' 
' greater the amount of error in measurement, the lower the - 


reliability coefficient. : ry if 3 , P | : ; 


x , oa s +. 


~ 
oe 


& HAS aati): argue that the ‘level of reliability . test > ° s 


“must, jive’ is a | funeticn of ene kid of decision being wade, ~~ j 


Nunnally (1967), for. example, states sine when tests are 
wae in’basic research’ studies, a reliability of ..50 or 
.60 will suffice, but that "In tiene lied canes 
where important decisions are made with respect to 
specific test scores, a “reliability of .90 ie cthe nini- oe 
mum that should be tolerated, and a reliability of 95 

. should be considered the desirable standard" (p. 226). 
| Tablgé-3 is a list of the reliabilities of some of ~ ‘ 
ie tests amis used to asaess Lente disabled chile 

ses, The. reliabilitiee he those reported by the a 

authors themselves in: CENeE: manuals or techndcad reports 
for the tests. The table ‘can be summarized by noting that, 

none of the tests listed has the reliability necessary . 

for use in making es a ai bay chopducaetonat decisions. 


In tee. most a Ene: tests lack the, REGESeaEY ae aac 


to be used for seriviamtgl buvposese 
: v 


Rn. LE OC sil 
The figures in the right-hand ‘column of Table 3 indicate 
that there is great variability (1% to a9%) in the predicte- 
bility gained by using tests as opposed to using nothing. 
These indexes of forecasting ef etency (cailed "coefficients 
* oF alienation") vary with the Anetrument used ‘and the age of 
the student tested, but none is especially Bagh Such infor- 


* mation further points to the questionable reliability af aint 


mace uged to assess. learning disabled children. 


- 


Validity. Before a test can be said to assess what it — 


claims to assess‘, it must first ha shan to be reliable. 
. Reliability is a necessary but not sufficient condition 
3 for validity. Those tests that are unreliable cannot be 
. . considered valid. * 
hated hvtouailys the twin. issues of limited evans | 


\ e 
ang validity of assessment devices underlie many y of the 


current eatravdratal issues relevant to the field of ~ » ®t 
learning disabilities. Deficiencies in a host of test- - ‘ 
SS saowetiied factors have been cited as indicative of” learn- } 


‘ing disabilities ‘ied — been said to cause academic failure 


We do not have the technical adequacy to measure’ accurately 


the things we go aes talk about. ’ . ; > 


f 
, . - 2 


r) , sd 


The Use of Deficit Scores to Identify the Learnif Disabled 


"Children labeled learning disabled are said to deapnntebie test- 
‘identified and test-named deficits. Table 4 Sista some of the deficits 
sand disorders that have been attributed to learning aapabiee children. 
In practice, children are Bete to démonatentn dees deficits because 
they earn sable’? scores on tests of the saffe name than oe do on 
intelligence teste. Visual sequential memory" deficits, for example, 
are identified by eeiavesely low-level performance. on‘ the wtauiel 
sequential memory subtest of the Illinois Test of Psycholinguistic : 

- Abilities. “ i Mer eS 


, Insert Table 4 about here.’ 
: eh So ere 


Be 


a, eons 3 , eo ean § e- 73 
The fecha: in deficit-based identification of learning dsoabst 


ties is twofold. First, as I have illustrated, the tests used have ° 
Pf . , 


fe: ERPSADRUECIEE More importantly, difference scores _are nearly 
always less reliable than the’ tests used oS identify aifferénces. 

/ ® Statistical formulas ies been developed to quantify the ePiadasd 
error of measurement.:for difference seStea, These formulas are listed 


in Table 5. 


Insert Tabla 5 about here - ; ‘ 


; i) - \ : . 
Salvia and Clark (1973) used these formulas to illustrate the , * 


{ 


fact that, considerable misidentification occurs when difference scores. 


are used to identify ‘learning disabled children. : at 
- The toove ‘addvessed here is misidentification or misclassi fication. 
We identify children as cir ie disabled ao we can serve them. | 
Identification is based upon deficits, which are deunastrated vere 
- \devtces with limited reliability. In all deviduvieas, we might ; 
8 gest that the great variability in current estimates of the tnd ( 


of learning disabilities (ranging from 12% to 302 of the school . 


. 


; den 


age pokhulation) simply reflects the large amount of errdér in our ‘ 


‘ measuremant devices. 


Bias in Asséegsment 
Public 94-142 mandates nondiscriminatory adeanenents The 

law sssette (Ger 615-5e) thatatates and their localities will j 

develop: 


Procedures to assure that testing and evaluation eaten 
rials and procedures utilized for the purposes of evalu- 


a 


- 


as X a / 


’ ation and placement of handicapped children will be 
selected and’ administered so as not to be racially or, . 
culturally discriminatory. Such materials or procedures 
shall be provided and administeréd in the child's native 


td 


language or mode of communication, unless it clearly is exe 


_ Not feasible to do so, and no single procedure shall be 
* the sole criterion for determining | an SRUPODELERS duca- 
sional program for the child, 


“In their quest to comply with the requirements of Public Law 
94-142, teams in local education agencies are ‘currently engaged in 
consiiecayie effort to identify tests and test items which are rac- 
salyond Aiveealty fair. I believe they can do so for a very long 
time without achieving even minor success. 

Those who currently seek to identify nondiscriminatory tests 
should learn from the history of such efforts. Not only have psy- 
chologists failed to identity tests which are fair, but also they 


have not been able to reach agreement on the concept of fairness. 7 


Directly contradictory definitions of test faitness are proposed by 


. such noted measurement experts as Cleary, Cole, and Thorndike. In . 


a real sense, nondiscriminatory assessment is like non-fatal death. 
Educators can, with chyieus futility, debate the fairness of dtems 
tee groups 6f children for a very long time.: . 

ne I see it, the issue we should be addressing is bias in 


A 


een a which would still-exist even if we were suddenly to have 


the fair test. Salvia and his colleagues have addressed this issue 


in a number of investigations (Algozzine, 1976; Podol & Salvia, 1976; 


~_ 


‘ Ross f& Salvia, 1975; Salvia, Algozzine & Sheare, in press; Salvia, 


Sheare & Algozzine, 1975). They demonstrated that naturally“ occurring 


e . 


pupil characteristics act to bias the decisions which teachers make 


Le 


, 
\ : : e \ 
about children. Race, sex, socioeconomic status, and physical 


attractiveness have been shown to act as, biasing 'f@ctors in place- 
4 4 


t 


ment and treatment decisions made regarding children on whom there ‘ 
‘ : Sawa ‘ ; 
ap Pe is identical information. as - sa 
‘Bias Following Assessment . ; > 


In addition to the considerable amount of bias that occurs in’ 


" the “naking of psychoeducational decisions,-a considerable amount also 
ow 


% occurs Pattindine assessment as a function of the -label assigned ta a 
child. Foster and I (1976) eee the effects of deviancy 
“A labels ae teachers' expectations of child behavior and their ability 
to evaluate child behavior objectively. One hundred iimntes: school 
re feachers were. randomly assigned to one of os label groups. Each , 
group dealt with dne:label (emotionally disturbed, learning disabled, a 
mentally retarded, normal), and ‘each group perticé pated in two spepars fs oe 
ate treatment phases. During ofiada I, teachers” identified behaviors | , 
' they expected to.be displayed by hypothetical children denominated by 
the label condition. During phase i; each group saw the same video , 
2 ‘tape si a normal fourth grade boy: and completed a setond check1ist 
> based on the iehaytoxs displayed during,this presentation. Bapert= 
® mentat procedures were identical for whe four groups, except that each 


ay 


group. was told ene child was a member of a different category. | , a 
Renules of the investigation sadidated that teachers hold nega- ~ 

tive expectations toward children labeled as deviant and maintain 

thee expectancies even when confronted with normal behavior that*is 

. inconsistent with the stated label. Maintenance of this: bias.is 


. io i 
sufficient to cause teachers to mis@nterpret actual child behavior, ; oF 
he ; ° : ee 


re 


" a4 


. as 16 Po : - ,°" 
resulting in a halo effect. Results indicated/that the label “equcable 
i “thentally retarded" generated a greater degree of negative bias than dia’ 
x" the labels "learning disabled" or “emotionally disturbed," although all 
. say three deviancy Labeta produced negative expectations and halo effects 
significantly different from those found padar control conditions. tie 
iia research (Foster, Ysseldyke & Reese,, 1975; Lee, 1975; ‘Salvia, , 
Clark & Voueldyke: 1972) supports these findings. : 
The eee ae occurring in Soueeoncit falas much 2 omit " % 
problem" as it is a-problem specific: to ys use of bigtes- In our 
efforts to eliminate ids and discrimination in assessment, it is high 
x time we reject the practice of blaming tests and quit trying to find the 
ae ae ‘fair test. We can more constructively and profitably address our’ d 


efforts to identification of ways to modify or eliminate human bias, 
. 


o both in and following assessment. e 


Assessment of Abilities vs.. Assessment of Skills 
Assessment is only the first part of the asséssment-intervention 
. “a process. The nature of our assessment activities is pretty well dic- 
tated by the nature of interventions we tie with children. In avery 
"real sense, it is imperative that assessment be viewed witidn the 
iicchudasetotweeincion context. , 
we The "ability. training debate” has been with us for a long time 
and has been frequently addressed in the professional literature 
(Hammill & Larsen, 1974; Mann, 1970, 1971; Mann & Phillips, 1967; 
" Minskof£, 1975; Newcomer, Larsen & Hammill, 1975; Ysseldyke, 1973; 


Ysseldyke & Bagnato, 1976; Ysseldyke & Salvia, 1974). The current 


me 


debate, nhs multifaceted, boils ‘down pragmatically to hat should 
we assess aa train?" : 
| There are’ two fundamentally different approaches to the assess- 
ment got’ ereatnet children. who, experietce e soateets difti@ulties. 
’ Salvia and I (raseléyke & Salsas 1974) labeled these "task saa 
and "ability oes se These competing ss a differ tn the nature 
of the behaviors assessed and the nature of treatments or interventions 
used.”. , . : ‘7 a 
Those who espouse an ability training viewpoint believe that there 
' are specific abilities that underlie the acquisition of academic skills, 
and that for most children failure to acquire academic oftie is a direct — 
“result £ fundamental ability deficits. When children fail academically, 5 
coe 2 ot dente Sve aduintataeed bo identify the ability deficits 
that ies causing failure. Remedial programs are instituted to alle- 
viate or ameliorate the deficits and with the belief that such remedial 


i 
instruction is a necessary pre-requisite to academic success-~ 


Those who advocate a task analytic viewpoint reject-the notion 
that for most children underlying ability deficits cause academic diffi- 
culties. When chides fail academically, complex behaviors ace task 
eaaiiyead 4nd efforts are directed to adentst yay those enabling behav- 
logs aihich children do and do not demonstrate. | Typically, within this’ 
model, tests are not used. Specific assessment strategies (e.g., Bijou, 
Peterson, Harste, alten & ‘Johnson, 1969) are designed to ascertain 
the extent to hick children demonstrate specific skill development ~ 
strengths and weaknesses. Interventions are directed toward the teach- 


ing of specific skills. ° eS OES, 


- 


Salyia and I asaneidyhe & Salvia, 1974) identified four critical 


assumptions in d1agnostic-prescriptive teaching and examined ‘the extent 

to which the ability training and task analysis models” meet, those asSump- 
. , ; : . “ . +, y 

ttons. ‘The assumptions are listed in Table 6... First, it is assumed. that 


j : ‘ . gs 
children enter a teaching situation with igenethgcbie strengths and 


weaknesses. Those who espouse an ability training‘ viewpoint talk about 


‘ 
. 


and seek to: Aaenedsy ability strengths and weaknesses. Task analysts ~~ 


"s 


mn skill: developnient strengths cand wesinessen:. 


a a ee 


: : , a 
es : j Insert ‘Table 6 about here. 


c ? s 


4 


A fundamental assumption in diagnostic-prescriptive téaching is 


‘ 3 he. . . 
that the strengths and weaknesses assessed are causally related to 


. academic success. Within the ability training ‘model, correlates of‘, cm 


academic success and failure have been identified and have been pre- 


sumed to cause failure. Within the task’ analysis epadls there is no-+ 


search for underlying causes; skill development hierarchies are empha- 


fs t 


. 


sized. ™ 


4% 


A third assumption is that the strengths and weaknesses can be 


« 


reliably and validly assessed. We have seen earlier’ ‘that, current ‘ 
measures of processes and abilities lack both reliability and validity. 


The Sbility training, model, fails to meet this vital assumption. Within 


~ 


the task analytic model, skill development strengths and weaknesses are 4 


not assessed ysing traditional hormreferenced testing. Rather pro- 4 


° 


cedures with denonstrattd reliability are used to assess skill ee 


ment atrenente and weaknesses. 
‘ F ae 


: i a a, 19 ‘ 
Finally, it is assumed that- pupil pe¥tormance on tests tells us ' 
how ” teach. Evidence for ‘this within the ability krainiag sodel 
; requires evidence for’ aptitude-treatment interactions, 4 an extensive 
ae wai review of thé 1iteyature a diagnostic-prescriptive teaching in 1973 
a Glaseidyna,” 1973),-I found no evidence for aptitude-treatment inter- 


actions. 

4 , . : Historically, intervention efforts for learning disabled chide 

have been ability training efforts: an attempt is made to identify those 

process or ability deficiencies that Temes cause academic cme 

culties. The ability deficiencies are test-identified constructs we , 

Ae coce-groind difficulties," "form pegception difficulties"), , and -intef- 

ventions are designed to alleviate or ameliorate these ‘underlying causes 

of Mpadente difficulty. | Yet, to date, ther@ is little evidence that we 
are aie to assess ability strengths and deficits, reliably and validly. 

There is even less empirical evidence to support the contenfion that 

/ ae specific Sigcevontteus or treatments lead to desirable academic outcomes. 

“The task analysis model considers the identification of hypotheti- 
cal constructs presumed to cause academic difficulties. to be : 

" unnecessary; instead, the focus ta on assessment of current child char- 
acteristics tasually: “skills), and on prescription ‘of specific interven- 
tions based on a child's current level of academic ekill’ development. 

iv The modus is a test-teach-test model in which. specific poeahemnte have: . 

empirically aes The primary assumption in a task 


: , sigits model is that demic surcess or failure is due to an inter- 


7 * 
action between the chilld's mastery of the skills that, are prerequisite 


-»  * #0 successful completion of an academic task and :the characteristics 


% 


‘ 


| dren. 


20 . 
‘of that task. The task analysis model meets the assumptions listed 
ae at a to “he es 
earlier. ‘ gi 


i 


é 


3 me ANN, 8 Oo oe 
We need to address, DEEEeE than we- have in the past, the extent ' 
6 which assessment 6f learning disabled students should focus on 
ability assessment. The issues relevant to assessment which must be 


addressed are as follows: F * 

lt. Is there piieetne the contention that ability deficits 
underly the failure of students to acquire ee skills? 

2. Do efforts dentgned tb alleviate or ameliorate test-identified ~ 
ability deficits actually improve students": chances to succeed | 
acadeggcally? | | 

3. Can we continue to, support the practice of identifying pupil 

; ciesethe and weaknesses ‘and assigning instructional inter- 
ventions based on performance on non-reliable norm-refereficed 
tests? 

4. Can we continue to assign students to instructional inter- 
ventions:with little if any empirical support for the efficacy ; 


of those interventions? : > 


Who is to Test wid Decide? ee es ni 

Closely related to the other issues raised in this paper is the 
issue of who is responsible for assessing children and who is to make 
decisions regarding? the ptvcuanne-aF and intervention for these chil 
Currently, school psychologists, special education teachers, 


resource teachers, speech therapists, counselors, occupational thera- 


pists, and remedial reading‘ teachers engage in some aspects of assess- 
* = t no # 


t 


making. 


ment with children said to be Leseine disabled. 


Cognitive assessment is the turf of school psychologists in meat ’ 
states. Yet, training required to: be career te as a school psychologist hg 


varies froth state to state. One state (Alaska) specifies a bachelors 
\ 


: Shares now, require that teams of professionals participate in decision- 


rat 


‘Furthermore, most 


Ul 


degree as minimal training for certificatiot, eight states specify the 
‘ Fg 


4 
masters degree, Twenty-nine states require that a person must have + 
completed a six year program; seven states require the doctorate for 


certification. Brown and Lindstrom (1977) surveyed state department 


Vv 


requirements for certifying school psychologists, and reported that 32 ‘5 


states require coursework in specific content areas, two states specify 
‘ ¢ ar ' . 


COUTEGR, and 12 states use competency-based criteria. Clearly, require- 


ments for certification or. iieensure to test are not consistent through- 


out the nation, 


Most state aaa agencies require that assessment data oheeses ee 


by a credentiale® person be used in making important édicntionat ‘Getic & 


 fons- for handicapped children, Yet, it ‘is well known, though not- 


clearly. evipaabie that many school personnel ey administer and ~ 


authority to perform such. tasks. ’ Cledrly, the potential for abuse in a. 


interpret ‘individual testd*with neither the training nor the étatutory & OFF 


oer = 
assessment is considerable. To the extent that those who engage in 


assessment ' lack the necessary training and expertise to administer, 


score, and interpret pupil performance correctly, we stand a very good’ 


‘directly and profoundly affect their life opportunities. re a 


i] 


‘ 


_ chance of making many inappropriate decisions regarding children} which 
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{~ The Impetus for Change in Assessment 
Strategies and Activities 


3 
~ 


During the past decade, and certainly during the past few years, 


several forces, singly and in interaction, have produced an impetus’ 


‘ 
for change in the assessment strategies and activities used with 


school-aged children. ° The following specific: factors are impelling 


change. 


he 


‘ 


a a . : 
Increased Disillusionment on the Part of Classroom Teachers 
‘ » % + : : \ 
with the Kinds and Quality. of Assessment. ‘Classroom teachers 
v 7 ¢ 


have become increasingly vocal regarding what they perceive 


¢ 


as limitations in the kinds and quality of current assess- 
. ; ? Pad 


ment activities. | Study after study has shown, and my own. 


contacts with teachers support this finding, that classroom. 


, teachers, in general, view the school psychologist as a 


psychometric robot,.a number. getter, .whose sole .usefulness 


- 


\ ’ % . 
is his or her authority to ae a.deviant youngster from 


a classroom. | os : _ . 


t 
. 


Teachers want and need to know specifically what to 


do for and with children, both academically and behavior- 


\ 


ally. Rather than getting specifics, they. report that © 


” they typically receive generalities couched in impre- 


sive arrays of subtest scaled scotes, ‘grade equivalents, 
and psychological jargon. Rather than getting clear | . 
psychoeducational pictures of children and precise state- 
ments of specific skills which youngsters do and do not © 
have, they report that they have received statements des- 


ee 


cribing causes of,a child's. difficulties ranging from 
- 
: ¥ , ia 


2 2g * . 


; ys ' as a sa 
ee + ‘ ' unfulfilled tieeds and eRe, conflicts to pacante 


ability deficits. i" 


26 incredued Emphasis ‘on the Rights ‘of Children, The recent’ ; 


and significant revisions dn public. policy on the education 


: mi. of 3 WS of handicapped children are reflected in Public Law 94-142. 
haewnk judteial’ and ‘legislative rulings hire nandated zero 
| exclusion within educational settings, ‘appropriate edwens ' 


SOL eae *. tional progranming of all children in least restrictive an 
educational ‘eavivocneard, and maintenance of an educa- 


o? * 


tional ‘plan for éach handicapped pupil., Courts have acted» 
. ae in a vonieas of | caseg to insure equhl Protection of students. 


pe ae Vy Specific: cases have, addressed the provision of services to 
re * handicapped pupils... ‘ie | inust note: with special. attention 
he | the Fact: EnGE ‘the substantive idaus in aus all court 
cases relevant to ‘the education of handieaped students — : . 
a ae Se a : (Hobson v. Gene: 1967; Mills v. Bd. of Educ. 19725 


i mea . ; nat | P. v. Riles, 19723 Penns lvania Association for ‘Retarded x 
. 4 S % , ae = 
: Pa . Children v. Conmonyeall h “68 Penns ivania, 1972; ‘Washington * 


Vv. Davis, ae has eae ‘abuse’ fn assessment. - _Bersoff and 
+ 


ryan sal phat: - : oe roe 


” ° ; . 


we 


Courts ‘develop: rules .of conduct in piecemeal ‘taahion 7 
and only when litigants present legally cognizable : 
issues.” Rule-making ‘bodies, on the other hand, such, 
as legislatures and governgent agencies need ‘not wait | 
8 ; for complainjng parents or children to sue school’ sys- 

.| am & tems ., ‘When lawmakers. detérmine that certain problems ' 
aes need a. broader reach than courts” ‘can provide, when : 
problems begin to affect a great many people, or for 
other good reason, they begin to enact statutes and 
regulations which | Nye comprehensive effect. This ' 


ane a . process is invfull swing in special education. If 4 
OF we have just’ passed through the era of litigation, 
. ' . py rs 6 a oF 7 eae di. a & La 


. , 
. sas " oy) 
> : i 
f . 


the-mid 1970's are’clearly the era ‘of ‘legislation. ‘ 
It is in this legislation proclaiming the rights: of : | 

Zit ‘handicapped persons (and-.those misclassified as handi- ‘ 8 
capped) that SSBREaNEIY Baal most affected... ' 


(pp. 6-7). . . re a 
_ 4 ; . a 
_ 3. Mandated Nondiscriminatory ASnenaméntt, _I noted earlier that \ 
. ‘ : a mee. (a _* s’° 
> ~ Public Law 94-142 mandates nondiscriminatory assessment. The 


* -¥ ‘ 


/mandate is having, and will continue to have,-an inpact on 


the kinds of assesumént procedures and activities in which. 
. 4 “ 
educational personnel: engage... 


, 


4. Increased Activity in Mainstreaming Handicapped Children. 


Educational personnel are increasingly required to make 
a Oe 3 “ > ong at, de : teh ae 
o _ .reeommendations on the "least restrictive" placement of stu- 
- dents paberacars handicapped. Most have had training in 


distiinaishise only ' between pupdis who nerd self-contained 


clacement and ena who aout remain in saplitay classes. 


‘As the number of possible placements increases and the 

ial ‘Lines between them: ahift, training and retraining 

of thane’ who siuiwt’ make placement decisions is necessary. } ; , 
5. Increased ‘ev ueeaie Toward Individualization. of Instruction , 


for Increasing Numbers of Children. Public Law 94-142 man- 
. dates development of individualized‘ educational - programs- LOE onenerernntenrne 


all handicapped youngsters. A ‘written statement: is to be ° | * 2h 
Dome . ; "+ developed for each child..It is to mas (a) the child's Ne 

. present levels of educational performance, (b). the goals for, a 
at 2 | the entids tnetoding short-term instructional objectives, 


ie a ns a (c) the educational semiives to be provided to the child; 


. } including the extent to which the’ child will te able e 
ge a ee _ he i 


v 


oo hs 3." 3 participate in regular educational. programs, and (d) the 
projected date. for initiation and anticipated duration’ 


of services, and the criteria, procedures and schedules 


: for ‘evaluating whether instructional objectives are being # 
‘ =f ; achieved. . ‘ ° 
ie , ' ‘ NS 
- ‘The mandate for individual educational plans for handi- 
2 ae ; - capped) children will be implemented in most schools by teams ; 
ae a * fi * 


of regular and special educators and school psychologists. iy 
Ae ‘ * ae am 4, 
Few professionals are currently able to apply their 


a 


knowledge of assessment to program planning. Empirical 


o ‘ evidence for assessment-intervention links is missing. 
. . ; ‘ 5 - ® 
6. Due’ Process. Parents are becoming increasingly involved 


£ 


in educational planning for their children. Court man- 
dates have enunciated the right of children and their 


parents fo due process hearings when changes in educa+ 


I ‘tional programs are proposed. Current assessment pro- 


cedures will be challenged; diagnostic personnel must | 


be willing and able to back up their decisions with data. 


* Clearly, there are many forces serving.as an impetus for change _ 


+onnanninnnreenemmnd a “CUPFENt “assessment practices. ~te~te-fmperative that proféssionals 


“ 


carefully, consider the future of assessment activities and plot a ae 
‘course for: appropriate gssessment of “learning disabled -children. nt 


. 


‘ ‘The Appropriate Use of Assessment Information : 
ot firmly believe that it is incumbent on those who raise isqes . 
and address problems to propose mechanisms for dealing with those 


issues and problems. :I also. believe that no one person is able to . *,9 


. . ) t 
' 


, 4 * \ 


; % is . \ 
‘ 


address effectively the complex set of issues so apparent in assess- 


t 


ment of learning disabled children. Many professionals and profes- 


sional organizations have articulated their positions on the issues 


« 


I have described, and the one thing most obvious is that there is 


iJ 


‘consfiderable disagreement among those: most concerned about the: 


current state of affairs. a 6: 


Assessment is a criti€al component in the assessment-intervention 


proces Assessment data are used to make educational decisions, and 
aa ‘s s : 


we must consider ways in which the assessment data we collect inter- 
face with the kinds of decisions we make. One of the primary prob- 


lems" in the assessment ee learning disabled children has oes the 


ee of assessors to differentiate their strategies and tools in 2 
* + Linhe of the kinds of Secdviued to be made. We witness today con- 
siderable global thinking regarding assessment; tests are viewed 


as either "good" or "bad," there’ are calls for moratoria ceaee ’ 


-ing activity, and statements are aia’ that norm-referenced tests 
should never be used and that criterion-referenced assessment isa + “ 


panacea for all our testing ills. - = 


ey 


It is high time we engage in a facilitate differentiated assess- = * 
ee oe _No test “is tndversal ty Bone 2 for r all purposes, and a few tests 


: are universally bad for all purposes, - The extent td which specific ' oe 
> 
aecessment activities are appropriate. isa function of an interaction j 


Pe ee Oe a OO eee a” BT ceases eens otipee 
7 = 4 . 


between the kinds of data provided by those activities and the kinds 
ee 2 


of decisions we are required to wakes. Norm-referenced tests were 


x 


” A designed for the purpose of helping professionals make decisions re- ' 


‘quiring comparisons of individuals to groups (screening, placement, 


¢ 
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. 


evaluation of Andividyal pupil. “pronrens): they do a reasonably’ — 


effective job and generally are technically adequate fot that purpose. 


_ Information on pupil. performance M norm-referenced tests is, how- 


ever, relatively useless in plannfng instructional interventions. 
a = : ’ 


Interventions can best be planned on the basis of the extent to. . F 
which students demonstrate specific skills, information character-_ 


istically obtained from criterion-referenced tests. Those who assess 


_ children oftén use identical tools.-and procedures regardless of the 


decision to be made, Assessors must be trained or retrained to engage 


in differentiated assessment. 


A second, and obviously related; need is to view tests ~ 


as samples of behavior. - Pre-service training has typically 


consisted of education in the use of specific tests, and assessors 


too often approach the assessnen® of a pupil by asking "What tests a. ont 


¢ ; . x 


should I (or can I) give to this: ata” The appropriate question ! & 
in assessment ae "What behaviors: do I want to sample?" This dis- a 


tinction is important in that ae results in the use of specific tests . 
‘ 


| 


or subtests which will yield seats needed to help: make. decisions, 


. 
rather than simply yielding a set of test or subtest scores. Viewgng 


- 


“tests and test items as samples of behavior should keep us from making 
acti : REE | . 
unwarranted inferences based on test or subtest names. 


The third pressing need is the use of technically adequate assess- 


eae we a. 


‘ment devices with children. It is a fact that many of the norm- 


referenced tests currently used to collect data’ on childrep have been 


‘ 


' § a 
inappropriately abandent txts Assessors must continuously consider 


s 


the extent to which 4 children they assess have acculturation 


_ o ‘ | : 3 
! ae 


~ 
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’ comparablé to those on whom the test was standardized. Many~tests do 


( 


'* not report the nature of the group on whom they, were.standardized; 


a oners were inappropriately standardized. We should discourage 
the norm-referenced use of such devices: , 
eieties: I described the, issue of using ~inreliable tests. There 
are two “a to nepeeed in efforts to clean up thts practice. We 


' . could restrict assessment to the use of only those tests with suffic- 


ient reliability to be used in decifion-making. Obviously, -this. would . 
4 limit considerably the number of tests we eeate use. A second, and 

less restrictive, way of dealing with the reliability issue would be 
to recommend the use of estimated’ true scores rather than obtained 

. scores in interpreting pupil performance on norm-referenced tests. 

“Salvia and I (1978) describe in detail the reasons for saibig 

estimated true scores and the steps in computing ikea scores. Briefly, 
estimated true scores compensate, to a certain extent, for: limited ‘ 


e 


reliability ed PP ESRESERREN information about the test mean and the< 


test reldability, 7 ; . : 


‘Rypleuiiy, dtasnonttc personnel réport pbEaiies scores and, if : 
hey do so at eh construct their. Asean intervals seta obtained 


scores. I am eignentiag we compute estimated true scores for all ~- 


obtained ee construct confidence intervals around estimated 
5 he 


oe scores, and. interpret assessment. information in aight of these 


Aone tdacat Louies Such practices should ‘help etiainare sins of the 


error in assessment and contribute to more intelligent decision-making. - 


, 


I addressed earlier the issue of using difference scores to 


identify learning disabled children. Clearly such a practice is 


® . 


aa ata aa sere th ct Saree ag ee ee a ee eT age ee ee ee ae ee 
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=, 


rd 


fraught with problems and, is at best questionable. I want to go be- 
"yond simply recommending that assessment personnel compute the relia- 


bilities and standard errors of measurement for difference scores. 


I believe : should abolish the practice of using such scores to 


identify kearning disabled children. 


The issue of limited validity: for many currently used. assessment : 
devices can be addressed best by endorsing two of the regulations _ 
amuoneen by the Office’ of Civil Rights (Federal Register, July 16, 1976) 
relative to implementation of the Rehabilitation Act of 1973 (Public 

: bs Law 93-112 as amended by Public Law 93-516). OCR proposes that: * ‘ 
1. All evaluation devices must be property “as professionally 
validated for the specific purpose for which the: school 
proposes to use them, and 
_ 2. All evaluation devices must be recommended: by their pro- 


ducer for the specific purpose for which the school pro- 
’ * * 


- poses to use them and administered only by trained per- oe 
« * et 
sonnel. . =e, - -° ~ 
4 '‘ s ‘ » 
‘ Mandated nondiscriminatory assessment is a legal requirement that « ,* 


is going to be exceedingly difficult to comply with. re requirement 
is obviously closely entwined with the decision-making process in 

ee eee ge ee ee On ge 
wgactal education. The real issue is nondiscriminatory Maptatonenaltng: 


aan acenalabieneatthdannien nial aedaeiatiid 


For a variety of . ‘reasons, esis aia personnel are required to 


oe ~ ”~ meine 


m8 classify and place students. Norm-referenced assessment devices are 


used as data collection instruments in the dscision-sakiag process.. 


As noted earlier, current efforts to comply with the legal requirement 


of nondiscriminatory assessment consist primarily of efforts to identify - 
° . 


. 
& . 
: 
: 
‘ 
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the tests or test items that are fair for groups of-students. Such # 


ssceis will likely be futile. Fairness decisions can. be made, but 


only on an individual basis. Those who assess children: for the purpose 


of making plactment decigions must be ever aware of the extent to 


4 


* which the children they. assess have goculieuretion comparable to that 
of the group on whom specific’ tests were standardized. They wit be 
aware of the fate that validity “is abetoualy affected when children 

| ‘are compared to others who are ieee different from them, ; 
and that interpretations are limited in such casés. Other forms of 

_bias occur following assessment. : 

Considerable empirical evidence supports the contention that the 

kinds of decisiens made Fox: chivaven are biased as a function of 

naturally occurring characteristics such as race, sex, socioeconomic 

etude ethnicity, and physical attractiveness.. Also, educators hold 

negative expectations for. stereotypically labelled groups of children; 

and _they retain those stereotypes ‘even wnat confronted with behavio 

faconecunsk with the label, The question of how we cap eianEe thi 

situation and foster objectivity is an empirical question, We must 

F ; . banig: to identify specific ways of changing the expectations that 7 “ 


a ; educators hold for different groups of children, including those 


labelled handicapped, ‘acd to incorporate such procedures into pEeeeer / 


> : ‘ vice and. inservice training ot Reachers ae c 


. 


+ Educators have long debated and  hestedis discussed the question 


* ¢ « 


of which instructional approach’ is "best" for children. Joyce and 


* Weil (1972) effectively summarize the evidence on this question. : 
: che ‘ar 
The research evidence dealing with this question is re- i 
: tiarkably ambiguous. There have been several hundred . 
a studies comparing one general teaching method to another, 


: 34 | we 


ft & 


4 | : | * a 
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oe eee 


and the overwhelming portion of these studies, whether 
curriculums are compared, specific methods for teaching 

specific subjects are contracted, or different. approaches 

to counseling are analyzed, show few if any differences 

between approaches. ‘A}though.the results are very , 
difficult to incerpreff ch evidence to date gives no 
encouragement to thos@%ho would hope that we have identi~ 

fied a single reliable, multipurpose teaching strategy” 

| that we can use with confidence that it is the best 

| | approach, (p. 4) 


No one broad method of instruction is universally effective. 
Nevertheless, we have continued to assume that different methods are 
eitective with dittereit kinds of children, For better than a cee 
we have been assigning learning disabled childrem to specific instruc- 
tional piddcventtan’ with little or no empirical eyhdedce to support 

. the contention etint they will profit — ‘intervention. Hallahan 
and Cruickshank (1975) have noted some interesting distinctions be- 
event programs for learning disabled children and those who are in 
other ‘ways handicapped. They note that instructional geigvads for the 
mentally retarded were instituted only after considerable ‘research on 
learning in mentally retarded ‘persons. Prograns for learning disabled 


children were established prior to the pfesence of empirical evidence 


on ways of teaching ‘such children. The assumption that different 


J a 
- * children learn best when instruction is tailored to their individual~ 
‘+. differences brings us back to the assessment-intervention link. In 
snibeittmnpaanasoniaieattsseemmnatadatimeteacamiceneatetetadcommetaie the tidatet aera ih it eta aaa ttm nn anita ie aden ° 5 
nn, practice we have administered batteries of norm-referenced tests to 


al 


£ 


| children and have assigned them to instructional programs on the 


bn cepcmnet apres atime 


’ basis of their test performance. Again, we have little empirical 
; ; 
support for doing so. We have not demonstrated that ability deficits 
cause academic difficulties, that ability strengths and weaknesses 


$ 
can be reliably and validly assessed, or that there are interactions 
4 . . 


e 


io g * ag 


cul ture. The form_of -psychological assesment -now-moe 


a: 


32 
between children's performance on tests and the extent to which they ee 
profit from differential instruction. pw 

Research on che assessment-intervention - @ is eas eee 
needed. We must strive to develop reliable and valid measures of 
specific processes or sbitities, -We must, using an aptitude-treatinent 
interaction methodology, attempt to identify date rathois between .test 
performance and instructional treatments. A science of instructional 
intervention can come only following such Kesiatch endeavors. % 

In practice, it is time to call a bale “ti current djagnostic- 
oeueeipeine wehuite chacavieriead by assignment of children to 
ineffective instructional programs based ok their performance on un- 


reliable norm-referenced devices. Instead, we need to shift our. ~ 


» 


assessment-intervention efforts to strategies for which we do have . ae 
support. We should restrict our assessment to the assessment of 
specific skill development strengths and weaknesses, and our instruc- 
tional interventions to the teaching of skills (Kazdin, 1975; Kazdin 
Y . 
& Straw, in’press). Hunt (1975) states: 
Psychological assessment should guide teaching. It should 
‘ tell a teacher what kinds of assignments and curricular 
materials a given child can utilize profitably to foster 
his psychological development and pick up the knowledge : ‘ ( 
and skills which he must acquire in order to adapt to his 
prevalent in education fails utterably to do this. (p. 545) 


When planning instructional programs for children, it is imper- 


ative that we shift away from the currently dominant prediction 


e 


orientation to one that will facilitate instructional, planning. As 
Reynolds (1975) has observed: 

a * : 
( We are in a zero-demission era; tonsequently, schools re- 


‘quire a decision orientation othen than simple prediction; ra 
® * they need one that is oriented to individual rather than * 


: 36 ' : 


33 
institutional payff. In today's context, the measurement 


, # technologies ought to”become integral parts of instruction, 
oF: / ‘designed to make a difference in the lives of children and 


not just a prediction about their lives. (p. 15) 


Finally, we must decide who tests. Once again, this fnust be 
considered in Light of the kinds of decisions nade, using assessment : 
data. uddefully,, this question will not be ‘answered by simply assert- 
ing that opty those who hold the necessary ‘credentials should assess 
children, for it is réadily apparent that credentials and competence 
are too sited ineatatad dina who assess‘children must have thé 
necessary: training and expertise to do 80.” They must be skilled in'- 
establishing rapport with children, in correct test sduitdteteatton,. 
in scoring, and in interpretatiom. They must be able to evaluate the 
technical adequacy of the tests they use, ie Sasha the heheviors: 
sampled er te and to differentiate strategies ind tools in light 
of the kinds of decisions they are charged with making.’ Assuring that 
chs will occur is extremely difficult, and the obvious problens now 
apparent in the system must be addressed at several levels. 

First, pre-service training of pureed vated must include 


more training in the intelligent use of tests and assessment informa- 


tion. Second, considerab 


1° re-training of assessors must be done. . 


Most professionals have’ been inadequately prepared to meet the complex 
ated AN i0% it trareery i eee aga eRe * * 


set of demands now placed on them. Third, we must work with state Z 


4 departments of education in an effort to insure that only competent, 

a persdns are credentialled and that there is a system of continuing 
education for personnel charged with the task of gathering assessment 

"information and using it to make important decisions which diyectly 


. 


¥ 
and sigittiehaiy affect the lives of children. 


. 
: ’ 
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34 P = _ * : . 
I Boned in my {atroduction that the state of the art in assebs- ‘ A : 

‘ing jledining disabled chi en is not enod,. I Fans described the 
many reasons py t believe this is so. eG are wont of oe many 
aged be problens pee issues that must be addressed, and avareness, 


hopefully, ‘will lead to actida. I ask you to join me ‘i efforts to 


"improve current assessment and decision-making practices to the end 


‘that, someday, the only effect of assessment will be the enhancement 


. 2 > 
of children's life opportunities. - ; 2 i 


. 


og eas 
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ae Footnote Swe 
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. Aversion of this paper was: presented at the annual conference 
of the Minnesota Association for Children. with Learning Disabilities, 
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Minneapolis » November 1977. 
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Table 1 


Number of States and Respective Percentages of Components Included in State Definitions © 


Environmental disadvantaged 23 - 
‘ + 


Components Nay ve Percent 
Definition 
NACHC. only ~ s« RD 21h? 
NACHC with variations 1S 57% 3S 
Different 16 — 381% 
None ; 2 | 48% 
‘ y 
Intelligence | . 4 
' Average and’ above Ti. 26a2e 5 a 
Above mental retardation 8° 19.1% 
Not stated . ’ (23 54.8% 
Process > Sees 30 
Process disorder 36 §=685.7% 
Language disorder - 35 983.3% 
Academic : 
Reading , 31 73.8% 
» Writing 31 | 73..8%. - 
’ Spelling 31 73,82 a 
Arithmetic 31 = 73.8%. 
* + 
Exclusion - primary. 
Visual impairment 26 61.9% 
Auditory impairment - 26 - 61.9% 
Motor impairment 23 «54.8% 
Mental retardation 21 50.0% ~ 
Emotional disturbance 25 59.5% 
54.8% 


Components 


Exclusion - primary & secondary 
Visual impairment 3 
Auditory impairment 3 
Motor impairment 2 
Mental retardation , tad 
Emotional disturbance 1 
Environmental disadvantaged 1 


Neurological impairment * 
Included - 
Not included 0° 
Possible : 26 
Not stated 2. 
Affective ; 
““Includes emotionally _ 
disturbed - 4 
Includes socially mal- . ’ 
ad usted 6 
arias *. 
Miscellaneous, ; 
Attention, deficits’ ec 3 
Motor deficits ee 
Thinking deficits °"™ 
Discrepancy component 12. 


Special Education required 14 
Intraindividual differences 4 
Prevalence 2 


Chronological Age 7 4 


30 * 


From Mercer, c. ‘ Forgnione, C., & Wolking, We- D. Definitions of learning disabilities used in 
the United States. Journal of Learning Disabtlities, 1976, 9, aM 
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Table 2 


. 
L 


Tests with Norms That Are Inadequately Constructed or Described 


24 


. 


tet é 
“ oe 


w Arthur Adaptation of the Leiter International Performance Scale (13)? 
Bender Visual Motor Gestalt Test (15) 
_ California Achievement Test (9) ? 
..,,, Culture Fair Intelligence Tests (14) ; mt 
"Cognitive Abilities: (14) mt 
Developmental Test of Visual-Motor Integration (15)? 
Developmental Test of Visual Perception (15) - * : : ; : 
Qiagnostic Reading Scales (10) "4 
- Durrell Analysis of Reading Difficulty (10)” 
Full-Range Picture Vocabulary Test, (13)> : ee 
Gates-MacGinitie Reading Tests (9) ; 
Gates-McKillop Reading Diagnostic Tests (10)? , 
Gilmore Oral Reading Test (10) 
Goodenough Harris Drawing Test (14) 
Gray Oral Reading Test (10) p 
_ Henmon-Nelson Tests of Mental Ability (14) 
’ Illinois Test of Psycholinguistic Abilities (17) 
Memory for Designs Test (15) 
‘Metropolitan Achievement Test (9) 
~ Peabody Picture Vocabulary Test (13) 
Primary Mental Abilities Test (14) 
Purdue Perceptual-Motor Survey (15) . 
Quick Test (13) - 
Silent Reading Diagnostic Tests (10) 
losson Intelligence Scale (13) ‘ 
ve eee Intelligence Scale (13) 


Wide Range Achievement Test (9) v- 

‘Numbers in creations cutee: to che chapter in which the test ‘4s , ss, 
described. x 

b 


These tests include norms in their manuals but include no data 
about the group on whom the test was standardized. . 


+ 


* 


: } ‘ Table 3 ‘ , 


’ 


Frequently Used Ability Measures: eir Reliability and Forecasting Efficiency 


° 
. 


Reported test- Percent increase 


“Menace Kg retest reliability over chance 
Developmental Test of Visual Perception : -69 — 27.62 
Eye Motor . Coordination -29-.39 4.3- 7.9 
Figure Ground -33-.39 5.6= 7.9 
Form Constancy ‘ _ 267=.74 25.1-32.7 
Position in Space : ‘ -35-.70 6.3-28.6 
Spatial Relations . . ; 52-.67 *  14,6-25.8 
Bender Visual Motor Gestalt Test . -39-.66- 7.9-24.9 
: ‘ : . , \ 
Chicago Test of Visual Discrimination ; -35-.68 * + 6,3-26.7 * 
Revised Visual Retention Test. os : ieee 47.3 
Memory for Designs Test (Graham-Kendall) _ . .72-.90 30.6-56.4 
Primary Visual Motor Test ] 82 42,8 
Developmental Test of Visual Motor Integration -80-.87 40.0-50.7 *. 
Illinois Test of Psycholingudstic Abilities -66=.91 24.9-58.5 
_ Auditory Reception ~ ; | -36-.79 6.7-38.7 
- Visual Reception |- \ -21-.69 * 2,2-27.6 
Auditory Associat « -62-.90 21.5-56.4 
Visual Assaciation -32-.75 5.3-33.7 
Verbal Expression ~ 45-474 10.7-32.7 
‘Manual Expression _ -40-.70 8.4-28.6 © 
Grammatic Closure : ~ *49-.87 ~ 12.8-50.7 
Visual Closure »57-.82 17.8-42.8 
Auditory Sequential Memory ‘ ,  «61-.89 20.8-54.4 
Visual sageretset Memory : .12-.71 0.7-29.6 


From Ysseldyke, J. E. & Salvia, J. Diagnostic-prescriptive teaching: “Iwo models. 
Exceptional Children, 1974, 41, 181-186.. 
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Table 4: 


Some Examples of Deficits and 


% ‘ 
Disorders | Attributed to Learning Disabled Children , 


Visual Perceptual Deficit ‘ 
Fivure-ecqund Pathology ‘ | 6 

Auditory Processing Disorder rte 
Visual Seqyential Memory“Deficit é . 
Body ease coal ee : ‘ 

Eye-hand Coordination Difficulty 

Granmatic Glesusy Deficit ¥ 
Poor Setceptualnccoe Match 


Manual Expression Disorder 


Table 5 

* ‘ : 
Formulas for the Reliability and Standard: 
Error of Measurement for Difference Scores 


* 
. 


is (ea, + Thy) ~ Fab 


Pax(dif) * ¥ 
4 1 = Fab. 
SEM = sat + sb? - 2r Sa Sb l/ l‘-r ; 
(dif) ‘ ab xx (dif) 
~~ 
& 
* ee . 
rn. 
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. Table 6 ‘ 
‘ Assumptions in Diagnostic-Prescriptive Teaching 
* $ 
I. Children enter a teaching situation with strengths and weak- 
nesses. me ‘ Pug 
2. Strengths and weaknesses are causally related to academic 
- guccess, 
3. Strengths and weaknesses can be reliably and validly assessed. 
4. Pupils' performance on diagnostic devices tells us how to teach 


them. 5 
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